Invariance priors for Bayesian feed-forward neural networks
نویسندگان
چکیده
منابع مشابه
Invariance priors for Bayesian feed-forward neural networks
Neural networks (NN) are famous for their advantageous flexibility for problems when there is insufficient knowledge to set up a proper model. On the other hand, this flexibility can cause overfitting and can hamper the generalization of neural networks. Many approaches to regularizing NN have been suggested but most of them are based on ad hoc arguments. Employing the principle of transformati...
متن کاملSome Theorems for Feed Forward Neural Networks
This paper introduces a new method which employs the concept of “Orientation Vectors” to train a feed forward neural network. It is shown that this method is suitable for problems where large dimensions are involved and the clusters are characteristically sparse. For such cases, the new method is not NP hard as the problem size increases. We ‘derive’ the present technique by starting from Kolmo...
متن کاملFeed-forward neural networks: a geometrical perspective
The convex hull of any subset o f vertices of an n-dimensional hypercube contains no other vertex of the hypercube. This result permits the application of some theorems of n-dimensional geometry lo digital reed-forward neural networks. Also. the construction Of the convex hull is proposed as an alternative to more traditional learning algorithms. Some preliminary simulation results are reponed.
متن کاملGeometric Decomposition of Feed Forward Neural Networks
There have been several attempts to mathematically understand neural networks and many more from biological and computational perspectives. The field has exploded in the last decade, yet neural networks are still treated much like a black box. In this work we describe a structure that is inherent to a feed forward neural network. This will provide a framework for future work on neural networks ...
متن کاملEmergence of Selective Invariance in Hierarchical Feed Forward Networks
Many theories have emerged which investigate how invariance is generated in hierarchical networks through simple schemes such as max and mean pooling. The restriction to max/mean pooling in theoretical and empirical studies has diverted attention away from a more general way of generating invariance to nuisance transformations. In this exploratory study, we study the conjecture that hierarchica...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neural Networks
سال: 2006
ISSN: 0893-6080
DOI: 10.1016/j.neunet.2006.01.017